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We explore the high-dimensional chaotic dynamics of the Lorenz-96 model by computing the 
variation of the fractal dimension with system parameters. The Lorenz-96 model is a continuous 
in time and discrete in space model first proposed by Edward Lorenz to study fundamental issues 
regarding the forecasting of spatially extended chaotic systems such as the atmosphere. First, we 
explore the spatiotemporal chaos limit by increasing the system size while holding the magnitude 
of the external forcing constant. Second, we explore the strong driving limit by increasing the 
external forcing while holding the system size fixed. As the system size is increased for small values 
of the forcing we find dynamical states that alternate between periodic and chaotic dynamics. The 
windows of chaos are extensive, on average, with relative deviations from extensivity on the order 
of 20%. For intermediate values of the forcing we find chaotic dynamics for all system sizes past a 
critical value. The fractal dimension exhibits a maximum deviation from extensivity on the order of 
5% for small changes in system size and decreases non-monotonically with increasing system size. 
The length scale describing the deviations from extensivity and the natural chaotic length scale are 
approximately equal in support of the suggestion that deviations from extensivity are due to the 
addition of chaotic degrees of freedom as the system size is increased. As the forcing is increased 
at constant system size the fractal dimension exhibits a power-law dependence. The power-law 
behavior is independent of the system size and quantifies the decreasing size of chaotic degrees of 
freedom with increased forcing which we compare with spatial features of the patterns. 

PACS numbers: 05.45. Jn,05.45.Pq,47.54.-r,47.52.+j 



I. INTRODUCTION 

A common feature of spatially extended systems that 
are driven far-from-equilibrium is spatiotemporal chaos 
where the dynamics are aperiodic in space and time 
Important examples include the dynamics of the atmo- 
sphere and climate [2[ ; fluid convection [l|, |3| ; the convec- 
tion of biological organisms in the oceans [J] , the transi- 
tion to chaos in excitable media Q ; and the complicated 
dynamics of systems of reacting, advecting and diffus- 
ing chemicals [6j. Despite intense theoretical and exper- 
imental investigation many important challenges remain 
regarding how to characterize, control, and predict the 
dynamics of these large complex systems. 

A unifying feature of many of these systems is that the 
dimension of the attractors describing their dynamics in 
phase space is very large. This severely limits the use 
of sophisticated techniques of chaotic time-series anal- 
ysis [7| and of powerful geometry based descriptions of 
dynamical systems However, the use of Lyapunov ex- 
ponents to compute the fractal dimension does not suffer 
from these limitations and provides an important win- 
dow into fundamental aspects of the dynamics of high 
dimensional chaotic systems. Furthermore, the spectrum 
of Lyapunov exponents are inaccessible to experimental 
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measurement using currently available techniques which 
leaves their numerical computation as an important way 
to gain new insights. A physical understanding of the 
dimension and how it varies with system parameters can 
provide fundamental knowledge regarding the underlying 
nature of spatiotemporal chaos that can be used to guide 
the development of improved theoretical descriptions for 
experimentally accessible systems. 

A defining feature of chaos is the sensitive dependence 
of the system dynamics on initial conditions and the 
exponential separation of nearby trajectories in phase 
space [9|. The rate of separation is quantified by the 
spectrum of Lyapunov exponents Xi where i = 1, . . . , N 
with Xi arranged in descending order and N is the to- 
tal number of degrees of freedom in the system. For 
partial differential equations, although the phase space 
is infinite, the value of N is expected to be very large 
but finite corresponding to the dimension of the inertial 
manifold (c.f. For a system of coupled ordinary 

differential equations, as we study here, the value of N 
is equal to the number of independent variables. The 
summation of the first M exponents (where M < N) 
describes the growth of an M -dimensional ball of initial 
conditions in A^-dimensional phase space. The exact in- 
terpolated number of exponents required for the sum to 
vanish is the dimension of the ball that will neither grow 
nor shrink and is an estimate of the fractal dimension 
D\ of the strange attractor. Using a linear interpolation 
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yields the well known Kaplan- Yorke formula 

Dx = K + J2-^- (1) 

where K is the largest integer such that the sum of the 
first K Lyapunov exponents is non-negative [HI]. The 
magnitude of Da is an approximate value of the number 
of degrees of freedom acting in the system [IH, [l4| ■ 

Ruelle [IH initially conjectured, and numerical sim- 
ulation later confirmed (c.f. [Tt}), that the fractal 
dimension is extensive for large chaotic systems. More 
precisely, D\ increases linearly with the volume of the 
system L d where L is a characteristic length and d is 
the number of spatially extended dimensions. The ex- 
tensivity of D\ is a consequence of spatial disorder. If 
two subsystems are sufficiently far apart their coupling is 
weak and they contribute independently and additively 
to the overall dimension [l], [l3[ . Cross and Hohenberg [l| 
used this to define a natural chaotic length scale as 

where a volume £f will contain, on average, one degree 
of freedom. 

Using the above arguments, one intriguing possibility 
is that underlying spatiotemporal chaos are structures of 
volume ~ £j. This raises an interesting question: How 
does the dimension vary for changes in system volume 
that are smaller than One possibility is that D\ is 
proportional to the system size only on average. In this 
case, the variation of D\ would have a stepwise struc- 
ture with system size where the steps correspond to the 
addition of new degrees of freedom as the system grows 
large enough to accommodate them. A smoother tran- 
sition may also be possible where the new degrees of 
freedom are able to stretch or compress to match the 
system size. In light of this, the variation of D\ for 
small changes in system size can shed important phys- 
ical insight upon the basic nature and composition of 
spatiotemporal chaos (c.f. [ll. Il8l420| ). 

Questions relating to the precise variation of the fractal 
dimension with system size have been explored numeri- 
cally for several important model equations. O'Hern et 
al. explored the extensive chaos of a 2D coupled-map 
lattice with an Ising-like transition [16j . The fractal di- 
mension was found to exhibit significant deviations from 
extensivity near the onset of spatiotemporal chaos which 
rapidly decayed with increasing system size (here the 
number of lattice sites) . 

Xi et al. [13] explored the ID Nikolaevskii equation and 
Tajima and Greenside 19] explored the ID Kuramoto- 
Sivashinsky equation. In both of these studies extensive 
chaos was found and a systematic exploration of the di- 
mension was performed in the extensive regime. The 
fractal dimension remained linear to within the precision 
of the calculations to yield what is now referred to as 



microextensive chaos. It is important to note that nei- 
ther study focussed upon the approach to extensive chaos 
where deviations may be more accessible. At the larger 
system sizes explored it remains a possibility that devia- 
tions in the fractal dimension were too small to detect. 

Fishman and Egolf explored the ID complex Ginzburg- 
Landau equation over a range of system sizes including 
the approach to extensive chaos (18|. Significant devia- 
tions from extensivity were found to occur on a length 
scale consistent with £s which was used to suggest the 
presence of building blocks that compose spatiotemporal 
chaos [18j |. 

Computations of the fractal dimension have also been 
conducted for experimentally accessible systems such 
as Rayleigh-Benard convection (the buoyant convection 
that occurs in a shallow fluid layer heated from below). 
Extensive chaos was found in large periodic boxes [21| 
and in finite cylindrical domains [22j yielding a natural 
chaotic length scale $j«2 corresponding approximately 
to the width of a convection roll pair. However, such 
calculations are very expensive and it remains unclear 
if a fluid system such as Rayleigh-Benard convection is 
microextensive. 

The approach we take is to study the dynamics of a 
periodic lattice of coupled variables (discrete in space 
and continuous in time) whose equations of motion were 
originally developed by Edward Lorenz in 1996 with 
the dynamics of the atmosphere and fluid convection 
in mind [23[. The model has since become important 
in the study of forecasting spatiotemporally chaotic sys- 
tems. The model is now known as the Lorenz-96 model 
and is described in detail below. We compute the spec- 
trum of Lyapunov exponents and fractal dimension using 
standard approaches. The contribution of this paper is 
a systematic and careful study of the variations in the 
fractal dimension with changes in system parameters to 
gain physical insights into high-dimensional chaos. By 
exploring a simple model we are able to perform very 
long-time simulations, over many initial conditions, and 
for a broad range of system parameters. 



II. THE LORENZ-96 MODEL 

The Lorenz-96 model is a simple model developed by 
Edward Lorenz in 1996 to study difficult questions re- 
garding predictability in weather forecasting (23[. The 
model is constructed of variables that represent the con- 
tinuous time variation of an atmospheric quantity of in- 
terest, such as temperature or vorticity, at a discrete lo- 
cation on a periodic lattice representing a latitude circle 
on the earth. The discrete variables are coupled spatially 
and their equation of motion includes contributions rele- 
vant to fluid systems including a quadratic nonlinearity, 
dissipation, and a constant external forcing. However, 
the equations are phenomenological and can not be de- 
rived systematically from a more rigorous description. 

Despite these simplifications the Lorenz-96 model has 
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emerged as an important and often used model system for 
the testing of new ideas in the atmospheric sciences 124- 
[26| and in the general study of spatiotemporal chaos [13 ■ 
In our work, we explore the Lorenz-96 model as a numer- 
ically accessible model with phenomenological relevance 
to fluid systems. The computational cost of a systematic 
study of the variation of the fractal dimension with sys- 
tem parameters is significant. It is anticipated that our 
exploration of a simple model will yield new insights that 
can be used to guide future studies of more complicated 
systems. 

Mathematically, the Lorenz-96 model is a linear lattice 
of N variables where the dynamics of the kth variable is 
given by 



dXk 
dt 



(3) 



for k = 1, . . . , N. In this equation F represents an exter- 
nal driving, — Xk is a damping term, and the quadratic 
term is an advection term that has been constructed 
to conserve kinetic energy (represented as the sums of 
squares of Xk) in the absence of damping. We consider 
the case of constant external forcing F and where the 
the lattice is periodic in space. Although other boundary 
conditions are possible, periodic boundaries are of partic- 
ular relevance for the atmospheric systems of which this 
model was intended to describe. We will show that the 
chaotic and periodic solutions we explore are composed 
of traveling structures that travel completely around the 
periodic-lattice many thousands of times. In light of this, 
other boundary conditions such as an absorbing bound- 
ary, would have a very strong impact on the dynamics. 
We have not explored these possibilities in detail. 

The two parameters N and F completely determine 
the dynamics. The value of N is the system size and F 
is the magnitude of the external forcing. In the following 
we are interested in the variation of the fractal dimension 
with these parameters. We explore system sizes N > 4 
since N — 3 does not yield interesting dynamics due to 
the nature of the coupling. For small values of the forcing 
F < 8/9 it has been shown [24J that all solutions decay 
to the steady solution Xk = F. 

We compute the spectrum of Lyapunov exponents Xk 
and the fractal dimension D\ u sing the standard proce- 
dure described in detail in Ref. 28]. There are N expo- 
nents and for each exponent a set of equations linearized 
about Eq. ([3j) are evolved simultaneously to yield the dy- 
namics of perturbations arbitrarily close to the full non- 
linear system. These tangent space equations are 



dSX^ 

= X k -i5X k ? +1 + (Xk+i — X k -2)SX^}_ 1 



dt 



-Xk-iSX k l _ 2 



sx 



(i) 
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where SX^ is the ith perturbation about lattice site k 
and i — 1, . . . , N. The perturbations are reorthonormal- 
ized using a Gram-Schmidt procedure after a time tjv to 
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Each 



yield the magnitude of their growth 

reorthonormalization yields a value of the instantaneous 
Lyapunov exponent 
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1 



t 



In 
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This is repeated and the average value of Xk yields the 
finite time Lyapunov exponent 



1 Nt 



(6) 



i=l 



where Nt is the number of reorthonormalizations per- 
formed. The limit Nt — > oo yields the infinite-time Lya- 
punov exponent. 

In our numerical simulations, we begin from random 
initial conditions and use a fourth-order Runge-Kutta 
time integration with a time step At = 1/64. Typically, 
we integrate forward for 1000 time units before starting 
the calculation of Lyapunov exponents to ensure that all 
transients have decayed. At this point we begin integrat- 
ing the tangent space equations using t/v = 1- AH of 
our reported results are for very long simulation times 
t > 5 x 10 5 and we have computed results for each set 
of parameter values for 10 to 50 different random initial 
conditions. 



III. RESULTS 

A. The Variation of the Fractal Dimension with 
System Size 

1. Small External Forcing, F — 5 

We first explore the dynamics for a small value of the 
forcing term, F = 5, over a wide range of system sizes, 
4 < N < 50. We find that the dynamics are characterized 
by windows of periodic and chaotic behavior. Figure Q] 
shows space-time plots for Xk(t) illustrating the variety 
of dynamics present. In Fig. [TJa) the dynamics are pe- 
riodic for TV = 38 yielding a wave of constant velocity 
traveling from right to left. In Fig. [IJb) we show the 
interesting case N = 22 where the dynamics are chaotic 
with a small value of the fractal dimension. The dynam- 
ics consist of a distorted wave structure traveling from 
right to left. In Fig. QTc) chaotic dynamics are shown for 
N = 47. This illustrates the typical chaotic dynamics 
that we have observed where the traveling wave struc- 
ture is still apparent but with significant distortions and 
deviations. 

It is evident from these space-time plots that the time 
for a wave structure to travel completely around the peri- 
odic lattice ring is ~ 10 time units for sizes of the lattice 
rings used here. Our typical simulation time is on the 
order of 10 5 time units which indicates the number of 
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TABLE I: Characteristic length scales describing the dynam- 
ics. The first row are results for F = 5 and the second row 
are results for F = 10. £s is the chaotic length scale found 
using the fractal dimension, £o is the average wavelength of 
the deviations in the fractal dimension about extensivity, and 
£l is the average wavelength of the wave structure. 



complete rotations in one of our simulations is approxi- 
mately 10 4 . The very long simulation times were required 
to gather statistics with sufficient accuracy to address 
many of the subtle questions we study. Despite the sim- 
ple nature of the model studied the requirement for very 
long-time simulations is significant. Overall, this suggests 
that the slow and noisy nature of the convergence of the 
Lyapunov spectrum can pose significant computational 
challenges for more complicated models. 

Figure [DJa) illustrates the variation in dynamics with 
system size. The circles represent system sizes yielding 
periodic dynamics and the ordinate is the magnitude of 
the period duration. For systems N > 5 the period of 
oscillation is approximately 2 time units. The triangles 
represent system sizes that yield chaotic dynamics. In 
order to combine all of the results on a single plot the 
chaotic states were arbitrarily assigned a period of '0'. 
For each system size N we performed 10 long-time nu- 
merical simulations starting from different random initial 
conditions. The type of dynamics found was independent 
of the initial conditions used. The size of the windows of 
chaotic dynamics are largest for the smaller system sizes. 
For TV > 27 the chaotic solutions appear in windows of 
4-lattice spacings with the occurrence of a single 5-lattice 
window yielding an average size of £ c — 4.1. The chaotic 
dynamics are separated by windows of periodicity of 1- 
lattice spacing with one occurrence of a 2-lattice window 
to give an average size of £ p = 1.2. 

Figure[5Jb) shows the variation of D\ with system size 
N. The circles represent the fractal dimension for system 
sizes yielding chaos and the solid line is to guide the eye. 
The error in D\ at each value of N is ~ 1CP 2 as deter- 
mined by the standard deviation in the fractal dimension 
from simulations initiated with 10 different initial condi- 
tions. The dashed line is a linear curve fit through the 
data for N > 27 to yield an estimate of D cxt describing 
the dimension of extensive chaos. In all of our calcu- 
lations of D\ we use a 3rd order polynomial curve fit 
to determine an accurate value for the number of Lya- 
punov exponents that must be included for the sum to 
vanish (the curve fit uses only the 4 sums with the values 
closest to zero). The arrows highlight the gaps between 
chaotic dynamics indicating system sizes yielding peri- 
odic dynamics. Using the slope of the dashed line of 
Fig.[UJb) and Eq. (0) the chaotic length scale is £5 = 2.6. 
For reference, the characteristic lengths determined from 



our calculations are collected in Table |TJ Therefore the 
size of the windows containing chaos are £ c = l.6£,$ and 
the size of the windows containing periodic dynamics are 
C P = 0.46&. 

To quantify the deviations of the dimension from 
purely extensive chaos we define, 



The overall maximum value of the deviation from exten- 
sivity occurs for N — 22 where AD = 0.77. If one only 
considers N > 27 the maximum deviation is AD = 0.17. 
To estimate the error in these calculations we computed 
results at each value of N using 10 different random ini- 
tial conditions. The standard deviation of the values of 
D\ is < 10 -2 which is too small to include as error bars in 
Fig. (2^b) . The deviations from extensivity exhibit regu- 
lar variations about the line of purely extensive chaos for 
N > 25. To quantify the length scale of these deviations 
we fit a curve through the data symbols to determine the 
average wavelength of these deviations which we will de- 
note as £o- Using this approach yields £0 = 5.7. If each 
wavelength £ contains a pair of degrees of freedom this 
yields £o/2 = 2.85 lattice spacings for the average volume 
of a single degree of freedom. It is interesting to point out 
that £o/2 ~ 1.1& suggesting that the deviations from ex- 
tensivity are due to the addition of new chaotic degrees of 
freedom as the system size is increased. This is similar to 
what has also been observed for the complex Ginzburg- 
Landau equation [l8l ]. 




FIG. 1: Space-time plots of Xk(t) for 15 time units after 
t = 5.1 x 10 5 indicated by t*. Dark regions are large values 
and light regions are small values: (a) N = 38, F = 5, peri- 
odic dynamics; (b) N = 22, F = 5, low-dimensional chaotic 
dynamics; (c) ./V = 47, F = 5, chaotic dynamics; (d) N = 38, 
F — 10, chaotic dynamics. 
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FIG. 2: The variation of the dynamics with system size N 
for F = 5. (a) Periodic dynamics (circles) where the ordinate 
indicates period duration and chaotic dynamics (triangles). 
Chaotic dynamics have been assigned an arbitrary period of 
'0' to fit on a single plot, (b) Deviations from extensivity 
illustrated by the variation of D\ with N. The circles are 
simulation results and the solid lines are to guide the eye. The 
maximum value of AD = 0.77 occurs for N = 22, for N > 27 
the maximum deviation is AD = 0.17. The arrows indicate 
windows of periodic dynamics. The error in these calculations 
is ~ 10~ 2 as determined by the standard deviation of D\ using 
10 different initial conditions at each N. 



We now compare these results based upon the use of 
Lyapunov exponents with what is found by analyzing 
the spatial and temporal characteristics of the patterns. 
Analysis of the patterns are of particular interest be- 
cause these measurements are often available in exper- 
iment whereas the Lyapunov exponent based diagnostics 
are not. Figure [3fa) shows the variation of the correla- 
tion time £t with increasing system size. The correlation 
time is computed from 



(X k (0)X k (t)) ~ e" 4 ^ 



(8) 



where (Xk(Q)X k (t)) is the autocorrelation of the fcth vari- 
able. The results shown are the time average value of the 



correlation time for the variable X\ (t) in the periodic lat- 
tice. Each data point is also averaged over simulations 
begun from 10 different random initial conditions. The 
open symbols represent chaotic dynamics and the filled 
symbols represent periodic dynamics. The results exhibit 
a scatter about the mean value of £t = 0.162 with a coef- 
ficient of variation of 9.6% (defined as the standard devi- 
ation divided by the mean) . The results indicate that the 
time dynamics remain relatively constant as the system 
size increases. 

To quantify the spatial variation of the pattern we have 
computed the average pattern wavelength £j, with in- 
creasing system size as illustrated in Figure (3^b) . The 
wavelength is computed in Fourier space using the loca- 
tion of the largest peak at small wavenumber to capture 
the size of the basic wave structure and is averaged over 
all time for each initial condition. Computation of the 
two-point spatial correlation length is difficult due the 
lack of an exponential decay in the correlation functions 
for the parameters we have explored. For smaller systems 
N < 10 the deviations are largest whereas for N > 10 the 
wavelength varies about an average value of £a rs 5.2 lat- 
tice spacings. For the chaotic solutions, the fluctuations 
about the average value over the 10 different initial con- 
ditions yields a coefficient of variation of approximately 
14%. For the periodic dynamics the wavelength of the 
periodic states were nearly identical to the precision of 
our calculations over the different initial conditions. 

Our space-time diagnostics indicate that with increas- 
ing system size the dynamics tend toward a state where 

fa 0.16 and £_l ~ 5.2. The wavelength of the pattern in 
the large system limit is £l ~ 2£a ps 2.2£o indicating that 
each wavelength of the pattern contains approximately 
2 chaotic degrees of freedom on average. In this case, 
it is useful to compare the deviations from extensivity 
with the variations in the wavelength of the patterns for 
increasing system size. 

The variation of £l about its mean value is quite sim- 
ilar to what is found for the deviations from extensivity 
AD as illustrated in Fig. [4] We plot the variation of the 
normalized wavelength £x, an d the normalized deviations 
from extensivity AD with the system size. The con- 
stant normalization factors are chosen such that the nor- 
malized wavelength and deviation from extensivity equal 
unity for N = 25 allowing both curves to be shown on 
a single plot. The circles are results for the wavelength 
of the pattern where solid symbols indicate periodic dy- 
namics, open symbols represent chaotic dynamics, and 
the solid line is a curve fit. The dashed line and the 
square symbols represent the deviations from extensivity. 
Gaps in the dashed line occur for system sizes exhibiting 
periodic dynamics. 

Figure 0] illustrates a correlation between the pattern 
wavelength and the deviation from extensivity. The gen- 
eral trend is that both the fractal dimension and the pat- 
tern wavelength increase with increasing system size until 
the pattern adjusts by adding an additional wave struc- 
ture to the periodic lattice effectively reducing the aver- 
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FIG. 4: A comparison of the variation in the normalized pat- 
tern wavelength £l and the normalized deviation from exten- 
sivity AD for F = 5 and N > 25. The constant normaliza- 
tion factor is chosen such that AD and £l each equal unity 
for N = 25 allowing both curves to fit on a single plot. The 
wavelength results are given by the circles and the solid line 
(open symbols are chaotic dynamics, filled symbols are peri- 
odic dynamics). The deviations from extensivity are shown 
by the square symbols and the dashed line where gaps indi- 
cate regions of periodic solutions. In both cases the lines are 
curve fits to guide the eye. 



FIG. 3: The temporal and spatial features of the patterns for 
F = 5. (a) The variation of the average correlation time £t 
with system size N. The dashed line is the average value of £t. 
(b) The variation of the pattern wavelength £l with system 
size. In both panels open symbols represent chaotic dynamics 
and filled symbols represent periodic dynamics. 



age wavelength of the pattern. With the addition of the 
wave structure the dynamics are periodic and the fractal 
dimension vanishes. A similar trend is seen in the work of 
Fishman et al. [18] where periodic dynamics were found 
for system sizes where the deviation from extenisivity 
was predicted to be a minimum for the one-dimensional 
complex Ginzburg-Landau equation. 



2. Intermediate External Forcing, F = 10 

We next explore the dynamics for a larger value of the 
forcing F = 10 over the range of system sizes 5 < N < 50. 
For each system size we have performed 50 independent 
numerical simulations starting from different random ini- 
tial conditions. Each simulation was allowed to continue 
until t = 5 x 10 5 and in computing our results we only 
used data in in the time interval 3 x 10 5 < t < 5 x 10 5 to 



ensure the decay of all transients and in order to gather 
good statistics. We found chaotic dynamics at every sys- 
tem size and for each random initial condition. A rep- 
resentative space-time plot for our results is shown in 
Fig. [Tfcl) for the case of N = 38. The patterns consist of 
distorted wave structures traveling from right to left. 

The spectra of Lyapunov exponents are shown in 
Fig. EJa) for six different values of system size. The re- 
sults are normalized by N and for extensive chaos the 
spectra collapse onto a single curve as expected. The 
solid line is the average of the results for the different 
system sizes shown. The variation of the summation of 
the exponents with the number of exponents is illustrated 
in Fig. [5jb) for the case of N = 40. The solid line is a 
6th order polynomial curve fit through the average val- 
ues of the data. The fractal dimension is indicated by the 
vertical dashed line at the location where the summation 
vanishes. 

The variation of the fractal dimension with system size 
is shown in Fig. [6j Figure |6][a) illustrates the variation of 
D\ with N where the symbols represent the average value 
over the 50 different initial conditions. An estimate of the 
error in these calculations is the standard deviation of the 
values of the dimension at each system size. Using this, 
the error is found to be quite small with a magnitude 
of ~ 10 -5 over the entire range of system sizes. The 
solid line is a linear curve fit through the data points 
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FIG. 5: (color online) (a) The variation of the Lyapunov ex- 
ponents Xk/N with k/N for k = 1, ...,N where N is the 
system size and F = 10. The solid line is the average value 
using all of the data, (b) The variation of the summation of 
the exponents with k for F = 10 and N = 40. The fractal di- 
mension D\ is the value where the summation vanishes. The 
solid line is a 6th order polynomial curve fit and the fractal 
dimension D\ is shown by the vertical dashed line. 



indicating extensivitiy. This yields a value of D oxt for 
any system size A~ and using Eq. ^ yields a value of the 
natural chaotic length scale of = 1.35. It is important 
to point out that since £g > 1, incremental changes in N 
by adding a single lattice site allow the variation in the 
fractal dimension to be observed for changes in system 
size that are smaller than the chaotic length scale. 

The deviations of the fractal dimension about extensiv- 
ity AD are shown in Fig. IHb) where we have used Eq. ([7]) 
and the solid line is to guide the eye. The magnitude of 
the deviation from extensivity for A" < 25 is ~ 5% at 
its largest value and tends towards zero with increasing 
N. Error bars are included and, over the entire range of 
system sizes, have a magnitude on the order of ~ 10~ 5 
which is 3 orders of magnitude smaller than the absolute 
values of AD. Due to the very small magnitude of our 
error bars we can discern these deviations in the fractal 
dimension from extensivity for all values of the system 
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FIG. 6: The variation of the dynamics with the system size 
for F = 10. (a) The variation of Da with N, the solid line is 
a linear curve fit through the data indicating extensive chaos. 
For N = 4 the dynamics are periodic and are not included 
in the curve fit. (b) The variation of the deviation from ex- 
tensivity AD with N. The circles are results from numerical 
simulation and the solid line is a curve fit to guide the eye. 
The deviations from extensivity are on the order of 5% and de- 
creases with increasing N. The fluctuations about the average 
values shown in each panel, as determined from the standard 
deviation of results from 50 different initial conditions, is on 
the order of ~ 10~ 5 . 



size. This suggests that the deviations from extensiv- 
ity are not entirely finite-size effects and are inherent to 
the underlying chaotic dynamics. For the larger system 
sizes 40 < A" < 50 the magnitude of the deviations from 
extensivity reduce to AD ss 10~ 5 . We note that over 
this range the magnitude of the error is on the order of 
~ 10 -6 and these small deviations are still an order of 
magnitude larger than the error bars. 

Figure HJb) illustrates that the variation of AD with 
A^ is non-monotonic in its oscillating decay in amplitude 
toward extensivity. The previous studies exhibiting de- 
viations from extensivity of O'Hcrn et al. [16] and Fish- 
man et al. [18] both observed a rapid monotonic decay 
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towards extensive chaos. At present we do not have a 
good understanding of the physical origin of the non- 
monotonicity in our results which is perhaps related to 
the discrete spatial structure of the Lorenz-96 model. 

It is useful to separate these findings into two regimes, 
a small system regime where N < 25 and a large sys- 
tem regime where N > 40. The small system regime 
includes the onset of extensivity whereas the large sys- 
tems are extensive. In a more complicated system, one 
would typically only have access to the deviations from 
extensivity for the small systems sizes since the devia- 
tions are largest in this range. However, this is also the 
regime where one could expect finite size effects to also 
be important and complicate the results. The large sys- 
tem limit is expected to be less influenced by these finite 
size effects and to provide a better estimate of the length 
scale of a chaotic degree of freedom. 

Over these two regimes we find that the wavelength 
of the deviations varies significantly. To quantify this 
we compute the zero crossings of AD over each range to 
estimate the wavelength of oscillation about D cxt given 
by £o . For N < 25 there are 3 wavelengths with values of 
(3.3, 5.3, 1.9) that yield an average of £o ~ 3.5. Assuming 
each wavelength of AD corresponds to the addition of 
two degrees of freedom yields £o/2 ~ 1-75 for the size 
of a single degree of freedom. Comparison of this length 
with the natural chaotic length scale yields that the size 
of a single degree of freedom is approximately 1.3&. The 
large spread in the values of the wavelengths suggests 
some competition with pattern selection mechanisms. 

In the large system limit N > 40 there are 4 wave- 
lengths characterizing the deviations from extensivity 
with values (1.7, 1.7, 2.6, 2.3) yielding an average value of 
£o ~ 2. The magnitude and variation of the wavelengths 
are smaller than what was found for the smaller systems. 
Using the same arguments as before yields that the size 
of a single degree of freedom is £o/2 ~ 1. Comparison 
with the natural chaotic length scale yields that a single 
degree of freedom is 0.74^. As in the case of F — 5 the 
results yield that £o/2 ~ £s suggesting that the natural 
chaotic length scale and the wavelength of the deviations 
from extensivity are related. 

In order to better characterize the patterns we have 
also computed characteristic time and length scales de- 
scribing their dynamics. Our motivation is to provide 
further insight into the transition between the small and 
large system limits in order to separate finite size effects 
from dynamical effects related to extensivity. We are 
also interested in quantifying any relationship between 
the Lyapunov based diagnostics and the pattern dynam- 
ics. Figure EJa) shows the variation of the average corre- 
lation time £ t with N over 50 different initial conditions. 
The time dynamics are noisy and the correlation time has 
an average value of approximately £j ps 0.11 (indicated 
by the dashed line). The time dynamics are faster than 
what was found for F = 5 as expected for the increased 
value of the forcing term. 

Figure [7Jb) illustrates the variation in the average 
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FIG. 7: The temporal and spatial characteristics of the pat- 
terns for F — 10. (a) The variation of the average correlation 
time £t with system size N. The dashed line is the average 
value of £t- (b) The variation of the average pattern wave- 
length £l with system size. The solid line is a curve fit of the 
form £ L = 4.45 - 13.6iy~ 1S3 . 



wavelength of the patterns with N over the different ini- 
tial condtions. The wavelength variation shows two re- 
gions of interest. For small system sizes N < 20 the 
pattern wavelength increases rapidly. For larger systems 
the wavelength remains relatively constant with an av- 
erage value of £a ~ 4.5. The region of increasing wave- 
length corresponds to system sizes where the pattern se- 
lection is affected significantly by the size of the domain. 
This corresponds roughly with the region where the frac- 
tal dimension is approaching extensivity in Fig. [Hth). 
These trends are well captured by a power-law, the solid 
line in the figure is a curve fit through the data of the 
form £ L = 4.45 - 13.6A- 183 . The fluctuations of the 
wavelength about the mean value for these chaotic states 
yields a coefficient of variation of approximately 30%. 

These results suggest that our measurements of the 
deviations in the fractal dimension for the large system 
limit are quantifying the chaotic dynamics in a regime 
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that is not strongly affected by finite size effects. Our 
space-time diagnostics indicate that the pattern dynam- 
ics, in the large system limit, have temporal variations 
with £ t = 0.106 and a spatial wavelength on the order 
of £l = 4.45. In this case, £l = 3.3^5 indicating that 
a wavelength of the pattern contains, on average, 3.3 
chaotic degrees of freedom. A more detailed exploration 
of the relationship between and £5 for increasing values 
of the forcing F will be explored in the following section. 



B. Variation of the Fractal Dimension with Forcing 

In the previous sections we have considered the large 
system limit, defined as the limit where the chaotic de- 
grees of freedom are much smaller than the system size. 
This was achieved by holding the external forcing F fixed 
while the system size N was increased. This is the typi- 
cal manner to study spatiotemporal chaos and has been 
referred to as the 'spatiotemporal chaos' limit [l|. For ex- 
ample, in a Rayleigh-Benard convection experiment this 
could be accomplished by holding the Rayleigh number 
constant while increasing the aspect ratio of the convec- 
tive domain. 

However, it is also possible to explore the large system 
limit by keeping the system size fixed while increasing the 
external forcing. This has been referred to as the strong 
driving or 'strong turbulence' limit In this case, it is 
expected that the chaotic degrees of freedom will become 
smaller with increasing forcing to yield the large system 
limit. In a Rayleigh-Benard convection experiment this 
would be accomplished by increasing the Rayleigh num- 
ber in a convection domain of fixed size. It has been 
conjectured that the fractal dimension will also exhibit 
a power-law dependence with respect to the value of the 
forcing 

We have explored this strong driving limit in the 
Lorenz-96 model by performing a series of simulations 
for increasing values of F while the system size N is held 
constant. We studied 6 values of the forcing over the 
range 5 < F < 30. For any particular value of F we per- 
formed 10 numerical simulations starting from different 
random initial conditions and allowed the simulation to 
run for 5 x 10 5 time units to ensure good statistics. We 
computed these results for 5 different system sizes where 
15 < N < 35. 

It is more convenient to discuss these results using the 
intensive dimension density, 



(9) 



The variation of the dimension density with external forc- 
ing is shown in Fig. [3] Each symbol is the average value 
of the 10 simulations from different random initial condi- 
tions. The standard deviation of the results are ~ 10~ 5 
and have not been included as error bars due to their 
small magnitude. 
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FIG. 8: (color online) The variation of the dimension density 
S\ with the forcing F and system size N. The results are for 
5 different system sizes indicated in the legend. The symbols 
are simulation results and the solid line is a power-law curve 
fit through the average value of the data. Each symbol is the 
average value from results computed using 10 different initial 
conditions. The standard deviation of these results for each 
symbol is ~ 10~ 5 . 



The dimension density exhibits power-law behavior 
and the results for different values of N collapse onto 
a single power-law curve given by, 



■bF~ 



(10) 



where a = 0.93, b = —4.03, and a = 1.32. The power-law 
curve fit is given by the solid line. The coefficient a in this 
case is the predicted value of the dimension density for 
external forcing of infinite magnitude Soo . The scatter in 
the results is quite small for all values of F explored with 
the largest deviations occurring at the smallest value of 
the forcing. The coefficients of the power-law are also 
collected in Table HT1 for reference. 

The inverse of the dimension density is simply the nat- 
ural chaotic length scale £5 = . Therefore Fig. [8] can 
be used to illustrate the manner in which the chaotic 
length scale decreases with increasing forcing. This is a 
spatially discrete system with N degrees of freedom and 
the theoretical limit for the dimension density is S\ = 1 
corresponding to a chaotic length scale of a single lat- 
tice spacing £5 = 1. Using our results for yields a 
value of £5 = 1.08 for the chaotic length in the limit of 
infinite forcing. This is in contrast to a fluid system de- 
scribed by partial differential equations with an infinite 
number of degrees of freedom. It is interesting to note 
that the variation of the fractal dimension with the de- 
gree of external forcing has been explored numerically 
for turbulent Rayleigh-Benard convection to yield a lin- 
ear dependence [291 ]. 

We now compare several measures of characteristic 
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a 





a 




0.93 


- 4.03 


1.32 


K'/n 


0.007 


5.9 


2.6 







0.35 


0.56 




1.12 


39.74 


2.2 




4.38 


-290.8 


3.5 



TABLE II: The coefficients describing power-law trends in the 
data from numerical simulations exploring the chaotic pat- 
terns as the magnitude of the external forcing is varied. The 
first row is for the dimension density S\, the next two rows 
describe temporal scales given by the inverse leading order 
Lyapunov exponent X^ 1 and correlation time £t, and the fi- 
nal two rows are spatial scales given by the natural chaotic 
length scale (,$ and the pattern wavelength £l- The functional 
form of the power-law used is a + bF~ a . 



time and length scales for increasing values of the magni- 
tude of external forcing. Both the temporal and spatial 
scales decrease with increasing forcing as expected. The 
variation of these scales are well described by a power-law 
of the functional form given by Eq. (jTU)) . The variation 
of the inverse leading order Lyapunov exponent and the 
correlation time are shown in Fig O The symbols are re- 
sults from our simulations for each value of F. The value 
of A^ 1 yields a time scale related to the predictability 
of the system. The solid line in Fig [9](a) is a power-law 
curve fit using the values shown in Table [TTJ The inverse 
Lyapunov exponents have been scaled by the system size 
N so that all data can be represented on a single plot. 
The value of a = 0.15 represents X^ 1 /N for infinite F. 

Figure (5Jb) illustrates the variation of the average cor- 
relation time £j with increased forcing and over the 10 dif- 
ferent initial conditions for a large system with N = 35. 
The solid line is the power-law curve fit using the val- 
ues of Table [II] The fluctuations of the correlation time 
about the mean value over the different initial conditions 
is quite noisy and yields a coefficient of variation of 7.7%. 
In the limit of infinite forcing the average correlation time 
£t « 0. Our results suggest that the predictability de- 
creases faster than the correlation time indicating the 
possibility of at least two different time scales. 

The pattern wavelength and the chaotic length scale 
both decrease with a power-law variation given by 
Eq. (ITU1) for increasing values of the magnitude of the 
external forcing. The coefficients of the power-law varia- 
tion are given in Table [TTJ The variation of these length 
scales is shown in Fig. [TUTa). The pattern wavelength is 
represented using square symbols and the natural chaotic 
length scale is represented using circle symbols. The 
length scales have been normalized by their magnitude 
at F = 5 to facilitate a comparison using a single plot. 
The normalized length scales are referred to as and £o> 
respectively. The coefficient of variation, over the differ- 
ent initial conditions, for the chaotic length scale is quite 
small ~ 0.01% whereas the pattern wavelength measure- 
ments are quite noisy with a coefficient of variation of 
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FIG. 9: The variation of two characteristic time scales with 
external forcing F. (a) The variation of the normalized inverse 
of the leading order Lyapunov exponent X^ 1 /N. Data are 
shown for 5 different system sizes as indicated in the legend. 
The solid line is a curve fit through the data of the form 
X^/N = 0.007 + 5.9F" 2 ' 6 . (b) The variation of the average 
correlation time £t with F for a system size oi N = 35. The 
symbols are results from simulation and the solid line is the 
power-law & = 0.35F~ - 56 . 



~ 31%. 

It is clear that the natural chaotic length scale de- 
creases more rapidly than the pattern wavelength. The 
ratio of these two length scales yields an estimate for the 
number of chaotic degrees of freedom per pattern wave- 
length and is shown in Fig. [TO] For small values of the 
forcing there are approximately 2 degrees of freedom per 
wavelength which increases to nearly 4 degrees of freedom 
per wavelength for large values of the forcing. The sepa- 
ration of these two length scales suggests that for larger 
values of the external forcing significant contributions to 
the overall disorder are from sub-wavelength structures 
in the pattern dynamics. A clear signature of the sub- 
wavelength chaotic degree of freedom was not found using 
our spatial diagnostics. 



11 




5 10 15 20 25 30 

F 



4 




5 5 10 15 20 25 30 

F 



FIG. 10: The variation of two characteristic spatial scales 
with external forcing F for a system size of N = 35. (a) The 
normalized natural chaotic length scale £a (circles) and the 
normalized pattern wavelength £l (squares). The normal- 
ization factors used are the respective values of £a and £l at 
F = 5. The power-law curve fits for the unsealed length scales 
are & = 1.12 + 39.74F" 2 2 and £ L = 4.38 - 290.8F" 3 - 5 . (b) 
The ratio £l /£<5 yields an estimate for the number of chaotic 
degrees of freedom per pattern wavelength. 

IV. CONCLUSIONS 

Using a phenomenological model relevant to fluid con- 
vection and the atmosphere we have shown that the vari- 
ation of the fractal dimension with system parameters 
can provide physical insights into fundamental features 
of high-dimensional chaos. We have used the fractal di- 
mension to provide an approximate value of the num- 
ber of chaotic degrees of freedom in the system and to 
estimate length scales describing the underlying chaotic 



dynamics. 

If one considers only the space-time diagnostics of the 
correlation time and pattern wavelength the results ex- 
hibit significant fluctuations despite the use of very long- 
time simulations for numerous initial conditions. This is 
in contrast to what is found when using the fractal di- 
mension and suggests the possibility of features of the 
dynamics that have yet to be quantified in detail. Our 
results indicate that the length scale describing the de- 
viations from extensivity is approximately equal to the 
natural chaotic length scale which suggests the possibil- 
ity of important spatial structures that contribute signif- 
icantly to the chaotic dynamics. Clearly identifying such 
features, and relating them to experimentally accessible 
quantities, remains an important open challenge in the 
characterization of systems driven far-from-equilibrium. 

For systems of small size with low values of external 
forcing we find very complicated dynamics with windows 
of periodic and chaotic dynamics. This is similar to what 
has been found both numerically [3(3] and experimen- 
tally in fluid systems such as Rayleigh-Benard convec- 
tion. For intermediate forcing, extensive chaos emerges 
with the important feature of significant deviations from 
extensivity for incremental changes in system size. Our 
results suggest that such behavior may be present in ex- 
perimentally accessible fluid systems. The ratio of our 
measured length scales, such as the ratio of the chaotic 
length scale £5 to the wavelength of the deviations from 
extensivity £0 do not yield integer values as found for the 
ID complex Ginzburg-Landau equation (l8| . This is per- 
haps also due in part to the discrete spatial nature of the 
Lorenz-96 model. 

The variation of the fractal dimension with external 
forcing yields insights into the manner in which the 
chaotic length scale decreases as the strong driving limit 
is approached. In the case of increasing system size while 
holding the forcing fixed, extensive chaos occurs when the 
exponent relating the dimension and system size is equal 
to the number of spatially extended directions. However, 
a similar theoretical understanding of the growth in the 
fractal dimension with increased forcing remains an open 
challenge. The fact that our results are independent of 
system size is promising and suggests that perhaps this 
is an underlying feature of some generality. It is antic- 
ipated that our results will be useful in guiding future 
efforts to explore the extensive chaos of experimentally 
accessible systems. 
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